Electronic device for recognizing fingerprint using display

ABSTRACT

According to an embodiment disclosed herein, an electronic device may include a housing, a display panel including a plurality of pixels housed in the housing, a flexible printed circuit board electrically connected to the display panel, a fingerprint sensor disposed under at least a portion of the display panel and on the flexible printed circuit board, a display driver integrated circuit (IC) and a processor electrically connected to the fingerprint sensor and the display driver IC.

This application is a Continuation of U.S. patent application Ser. No.16/758,213 filed on Apr. 22, 2020, which is a National Phase Entry ofPCT International Application No. PCT/KR2018/013030, filed on Oct. 30,2018, and claims a priority to Korean Patent Application No.10-2017-0142034 which was filed on Oct. 30, 2017, the contents of whichare incorporated herein by reference.

TECHNICAL FIELD

Embodiments disclosed herein relate to a technology for providing a userinterface in fingerprint recognition using a display.

BACKGROUND ART

With the development of fingerprint recognition technology, anelectronic device (e.g., smartphone) equipped with a fingerprint sensoris widely used. Such an electronic device may release a screen lock orexecute various functions such as a financial transaction usingfingerprint information obtained through a fingerprint sensor.

The electronic device may brighten the brightness of a display to obtainthe fingerprint information. The light emitted from the display may beinput to the fingerprint sensor after being reflected from a user'sfinger. The fingerprint sensor may obtain the fingerprint information ofthe finger based on the input light.

DISCLOSURE Technical Problem

The electronic device may output a mask image when obtaining thefingerprint information. The mask image may refer to an image having asomewhat dark color to prevent glare of the user when the display emitslight brightly.

However, the timing at which the mask image is output and the timing atwhich the display emits light may be different. For example, when themask image is output later than the timing at which the display emitslight, the user may be blinded by the light emitted from the display. Onthe contrary, when the mask image is output earlier than the timing atwhich the display emits light, the screen may be dark due to the maskimage, and thus the user may be uncomfortable.

Embodiments disclosed in the disclosure provide an electronic device forsolving the above-described problems and problems raised in thedisclosure.

Technical Solution

According to an embodiment disclosed herein, an electronic device mayinclude a housing, a display panel including a plurality of pixelshoused in the housing, a flexible printed circuit board electricallyconnected to the display panel, a fingerprint sensor disposed under atleast a portion of the display panel and on the flexible printed circuitboard, a display driver integrated circuit (IC), and a processorelectrically connected to the fingerprint sensor and the display driverIC, wherein the processor may allow the display driver IC to output amask image having a specified brightness through the display panel at afirst timing when a contact by an external object is detected using theat least a portion, and allow at least one of the plurality of pixels toemit light using the display driver IC at a second timing correspondingto the first timing.

According to an embodiment disclosed herein, an electronic device mayinclude a processor, a display panel, an image sensor disposed in aspecified area of the display panel or under the display panel, and adisplay driver integrated circuit (IC) that drives the display panel,the display driver IC including a memory that stores an icon imageoutput to an area corresponding to the specified area, wherein thedisplay drive IC may identify reception of a signal related to a changein a brightness of the display panel from the processor, display abackground image having a specified brightness and the icon image basedat least on the signal, and emit light using at least partially an areacorresponding to the icon image to obtain information corresponding to afingerprint of an external object using the image sensor.

According to an embodiment disclosed herein, an electronic device mayinclude a processor, a display panel, an image sensor disposed in aspecified area of the display panel or under the display panel, adisplay driver integrated circuit (IC) that drives the display panel,and a memory that stores a mask image having a specified brightness,wherein the display driver IC may identify reception of a signal relatedto a change in a brightness of the display panel from the processor andoutput the mask image through the display panel based on the signal anda transparency of a first area of the mask image corresponding to thespecified area and a transparency of a second area of the mask imageexcept for the first area may be different from each other.

According to an embodiment disclosed herein, an electronic device mayinclude a processor, a display panel operable in a first operation modeof a specified brightness or a second operation mode different from thefirst operation mode, and a display driver IC that drives the displaypanel, wherein the display driver IC may identify reception of a signalrelated to switching from the first operation mode to the secondoperation mode, obtain an image including a transparency in a specifiedrange when the signal is received, synchronize a time point at which theobtained image is displayed on the display panel and a time point atwhich switching to the second operation mode is performed with aspecified time point, and display the image using the display panelwhich is driven in the second operation mode after a time point whichthe synchronization is made.

Advantageous Effects

According to the embodiments disclosed in the present disclosure, it ispossible to prevent the glare of the user. In addition, according to theembodiments disclosed in the present disclosure, user convenience may beimproved.

In addition, various effects may be provided that are directly orindirectly understood through the disclosure.

DESCRIPTION OF DRAWINGS

FIG. 1 illustrates a front surface of an electronic device according toan embodiment of the disclosure.

FIG. 2 is a cross-sectional view of an electronic device according to anembodiment.

FIG. 3 is a block diagram of an electronic device according to anembodiment.

FIG. 4 illustrates a user interface output through an electronic deviceaccording to an embodiment of the disclosure.

FIG. 5 illustrates a user interface output through an electronic deviceaccording to another embodiment.

FIG. 6 is a timing diagram of components included in the electronicdevice according to an embodiment.

FIG. 7 is a block diagram of an electronic device in a networkenvironment for recognizing a fingerprint using a display, according tovarious embodiments.

FIG. 8 is a block diagram of a display device for recognizing afingerprint using a display, according to various embodiments.

MODE FOR INVENTION

FIG. 1 illustrates a front surface of an electronic device according toan embodiment of the disclosure.

Referring to FIG. 1, an electronic device 100 may include housings 111and 112, a display 120, and a fingerprint sensor (e.g., 250 of FIG. 2).

The housings 111 and 112 may protect various parts included in theelectronic device 100 from external shock. For example, the display 120,the fingerprint sensor and the like may be mounted in the housings 111and 112, and the housings 111 and 112 may protect the display 120, thefingerprint sensor and the like from external shock. According to anembodiment, the housings 111 and 112 may form an appearance of theelectronic device 100.

The display 120 may output content (e.g., text, images, video, icons,widgets, or symbols) or receive a touch input (e.g., touch, gesture,hovering, or the like) from a user.

The fingerprint sensor may acquire fingerprint information of a finger10. For example, when the finger 10 contacts a fingerprint detectionarea 132 (or at least a portion of the display 120), the fingerprintsensor may acquire fingerprint information based on light reflected fromthe finger 10.

According to an embodiment, when the finger 10 contacts the fingerprintdetection area 132, the electronic device 100 may output a mask image131 (or display image) through the display 120. Herein, the mask image131 may refer to an image in which an area except for the fingerprintdetection area 132 has a specified brightness (or dark brightness).

According to an embodiment, the electronic device 100 may brighten thebrightness of the display 120 at a timing at which the mask image 131 isoutput. In other words, the timing at which the mask image 131 is outputand a timing at which the brightness of the display 120 is brightenedmay coincide with each other substantially. Therefore, light may beoutput through the fingerprint detection area 132, and light may behardly output through an area except for the fingerprint detection area132. Light output through the fingerprint detection area 132 may bereflected by the finger 10 and then input to the fingerprint sensor.

According to an embodiment of the disclosure, it is possible to preventflickering or glaring of the display (e.g., prevent a user fromrecognizing flickering of the display) and improve user convenience bymaking the timing of outputting the mask image 131 and the timing ofbrightening the brightness of the display 120 coincident with eachother.

FIG. 2 is a cross-sectional view of an electronic device according to anembodiment. FIG. 2 is a cross-sectional view taken along line A-A′ ofthe electronic device 100 shown in FIG. 1.

Referring to FIG. 2, the electronic device 100 may include the housing112, a cover glass 140, a polarizer 150, and a thin film encapsulation(TFE) 160, a display panel 170, a polyimide (PI) film 180, a bendingprotect layer (BPL) 190, a black layer 210, a support layer 220, adisplay driver IC (DDI) 230, a printed circuit board 240 (e.g., amodule-flexible printed circuit board (M-FPCB)), and a fingerprintsensor 250. The components illustrated in FIG. 2 are exemplary, and theelectronic device 100 may not include some of the components illustratedin FIG. 2 or may further include components not illustrated in FIG. 2.

The cover glass 140 may transmit light generated by a display. Inaddition, a user may touch an upper surface of the cover glass 140 usinga part of a body (e.g., the finger 10) to perform a touch (including atouch using an electronic pen). The cover glass 140 may be formed of,for example, tempered glass, tempered plastic, flexible polymermaterial, or the like. According to an embodiment, the cover glass 140may also be referred to as a glass window. Although the housings 111 and112 and the cover glass 140 are shown as separate components herein, thecover glass 140 may be a part of the housings 111 and 112.

The polarizer 150 (or the polarizing film) may transmit only lightvibrating in one direction among light incident on the cover glass 140.For example, the polarizer 150 may transmit only light vibratingvertically and block light vibrating horizontally.

The thin film encapsulation 160 may be disposed in the −z direction ofthe polarizer 150. The thin film encapsulation 160 may protect pixelsdisposed on the display panel 170.

A plurality of wires and a plurality of pixels may be disposed in thedisplay panel 170. For example, a plurality of gate lines and aplurality of data lines may be disposed in the display panel 170, andthe gate lines and the data lines may cross each other. The pixels mayemit light based on signals supplied from the gate lines and the datalines.

The PI film 180 may be disposed in the −z direction of the display panel170. The PI film 180 may include a wire for supplying power and/or asignal to the display panel 170. According to an embodiment, the PI film180 may be formed of a bendable material and may extend from the displaypanel 170 to the printed circuit board 240.

The BPL 190 may be disposed in a bent portion of the PI film 180,thereby preventing the PI film 180 from being damaged.

The black layer 210 (e.g., an embo layer including an uneven pattern)may be disposed in the −z direction of the display panel 170. The blacklayer 210 may block light generated by the display panel 170 or lightincident from the outside.

The support layer 220 may be disposed in the −z direction of the blacklayer 210. The support layer 220 may be a buffer layer (e.g., a spongelayer). The support layer 220 may protect other components inside theelectronic device 100 by absorbing an external shock.

A heat dissipation member (not shown) may be disposed in the −zdirection of the support layer 220. The heat dissipation member may bemade of copper (Cu) or graphite to block electro-magnetic interferencebetween the display panel 170 and other parts.

The display driver IC (DDI) 230 may be disposed in a portion of the PIfilm 180. The display driver IC 230 may control the display panel 170through the PI film 180. For example, the display driver IC 230 mayenable at least a portion of the display panel 170 to emit light.

The printed circuit board 240 may be electrically connected to a portionof the PI film 180. For example, the printed circuit board 240 may beelectrically connected to a conductive pattern (or wiring) formed on thePI film 180.

The fingerprint sensor 250 may be disposed on the printed circuit board240. The fingerprint sensor 250 may obtain fingerprint informationthrough a hole 132 h formed in the black layer 210 and the support layer220. For example, when the finger 10 contacts the fingerprint detectionarea 132 (at least a portion of the display panel 170 when the displaypanel 170 includes the cover glass 140), the electronic device 100 maybrighten the brightness of pixels disposed on the display panel 170.Light emitted from the pixels may be reflected by the finger 10 andincident onto the fingerprint sensor 250 through the hole 132 h. Thefingerprint sensor 250 may obtain fingerprint information of the finger10 based on the incident light.

According to an embodiment, the electronic device 100 may output themask image 131 through the display panel 170 when brightening thebrightness of the pixels. That is, the timing at which the mask image131 is output and the timing at which the brightness of the pixelsbecomes bright may coincide with each other substantially. Therefore,when viewed from above the cover glass 140, an area except for thefingerprint detection area 132 may appear dark.

According to an embodiment of the disclosure, it is possible to preventflickering of the display or glaring of a user (e.g., prevent a userfrom recognize flickering of the display) in fingerprint recognition bymaking the timing at which the mask image 131 is output and the timingat which the brightness of the pixels is brightened coincident with eachother substantially.

According to an embodiment, the display panel 170 may include the coverglass 140, the polarizer 150, the thin film encapsulation (TFE), and thepolyimide (PI) film 180, the bending protect layer (BPL) 190, the blacklayer 210, and the support layer 220. In this case, when the finger 10touches at least a portion of the display panel 170, the electronicdevice 100 may brighten the brightness of the pixels. Light emitted fromthe pixels may be reflected by the finger 10 and incident onto thefingerprint sensor 250 through the hole 132 h. The fingerprint sensor250 may obtain fingerprint information of the finger 10 based on theincident light. The display panel 170 shown in FIG. 2 is exemplary, andthe display panel 170 may further include other components not shown inFIG. 2.

FIG. 3 illustrates a block diagram of an electronic device according toan embodiment of the disclosure. FIG. 3 illustrates a block diagram ofcomponents included in the electronic device 100.

Referring to FIG. 3, the electronic device 100 may include anapplication processor 310 (AP), a display driver integrated circuit(DDI), and the display panel 170.

The application processor 310 may include a central processing unit(CPU) 311, a graphic processing unit (GPU) 312, a display controller313, a compression encoder 314, and a mobile industry processorinterface (MIPI) transmitting module 315.

The central processing unit 311 may generate control information (orinstructions). The control information may allow the electronic device100 to enter a specified mode or select first image data to be output tothe display panel 170. Herein, the specified mode may be referred to asa high brightness mode (HBM) in which pixels emit light brightlyinstantaneously, an always on display mode (AOD), a screen lock mode, orthe like.

The graphic processing unit 312 may generate the first image data. Thefirst image data may refer to various guides, icons, and the like,output through the display panel 170. The guide is a visual indicator(VI) surrounding the fingerprint detection area 132, and the user mayrecognize the timing at which the finger 10 is to make a touch and aposition of the fingerprint sensor through the guide. The icon may be,for example, an image of a fingerprint shape, and the user may recognizea position at which the finger 10 is to make a touch through the icon.

The display controller 313 may transmit control information receivedfrom the central processing unit 311 and/or the first image datareceived from the graphic processing unit 312 to the compression encoder314. The compression encoder 314 may encode the control information andthe first image data in a specified manner. According to an embodiment,the process of encoding the control information and the first image datamay be omitted or bypassed. The MIPI transmitting module 315 maytransmit the control information and/or the first image data to thedisplay driver IC 230.

The display driver IC 230 may include an MIPI receiving module 321, anMIPI display serial interface 322, a serial interface receiving module323, an interface controller 324, a graphics RAM 325, a commandcontroller 326, a graphics RAM controller (GRAM controller) 327, atiming controller 328, an internal oscillator 329, a compression encoder331, an up-scaler 332, an image generation module 333, a memory 334, ahardware overlay module 335, a shift register 336, a gate driver 337,and a source driver 338.

The MIPI receiving module 321 may receive the control information and/orthe first image data from the MIPI transmitting module 315.

The MIPI display serial interface 322 may set an address at which thefirst image data received by the MIPI receiving module 321 is to bestored in the graphic RAM 325. The MIPI display serial interface 322 maytransmit control information to the interface controller 324.

According to an embodiment, the central processing unit 311 may transmitthe control information to the serial interface receiving module 323,not to the display controller 313. The serial interface receiving module323 may transmit the control information received by the centralprocessing unit 311 to the interface controller 324.

The interface controller 324 may allow the graphic RAM 325 to store thefirst image data. According to an embodiment, the interface controller324 may control the graphics RAM 325 such that the first image data isstored at an address set by the MIPI display serial interface 322. Inaddition, the interface controller 324 may transmit the controlinformation to the command controller 326.

The graphics RAM 325 may store the first image data. In this case, thegraphic RAM 325 may store the first image data at an address set by theMIPI display serial interface 322.

The command controller 326 may control the graphic RAM controller 327,the timing controller 328, and the internal oscillator 329 based on thecontrol information. For example, the command controller 326 may allowthe graphic RAM controller 327 to select at least a part of the firstimage data stored in the graphic RAM 325.

According to an embodiment, the command controller 326 may enable thetiming controller 328 to control driving timings of the gate driver 337and the source driver 338. For example, when the control informationincludes a command for directing the electronic device 100 to enter theHBM, the command controller 326 may allow the pixels disposed on thedisplay panel 170 to emit light brightly instantaneously. A signal forcontrolling the timing controller 328 may be transmitted directly to thetiming controller 328 or may be transmitted to the timing controller 328through the internal oscillator 329.

The graphic RAM controller 327 may select at least a part of the firstimage data stored in the graphics RAM 325. For example, the graphic RAMcontroller 327 may select at least a part of the first image data basedon the address of the first image data and/or the size of the firstimage data.

The compression encoder 331 may encode the selected first image data.The size of the first image data selected may be reduced through theencoding process.

The up-scaler 332 may enlarge the first image data at a specifiedmagnification.

The image generation module 333 may transmit the first image data to thehardware overlay module 335 or generate second image data and transmitthe second image data to the hardware overlay module 335. In thedisclosure, the second image data may refer to the mask image 131described with reference to FIG. 1.

According to an embodiment, the second image data may be generated bythe graphic processing unit 312. In this case, the second image data maybe stored in the graphic RAM 325 or the memory 334. The image generationmodule 333 may transmit the second image data stored in the graphic RAM325 or the memory 334 to the hardware overlay module 335.

The hardware overlay module 335 may blend at least a part of the firstimage data and/or at least a part of the second image data and transmita result of the blending to the timing controller. For example, thehardware overlay module 335 may blend a guide, an icon, the mask image131, and the like to transmit a result of the blending to the timingcontroller. The blended screen may be output through the display panel170.

The shift register 336 may change a position at which the first imagedata and/or the second image data are to be output on the display.

The gate driver 337 and the source driver 338 may transmit a gate signaland a data signal to the pixels such that the pixels emit light.

The display panel 170 may output the first image data and/or the secondimage data through the pixels.

According to an electronic device according to a comparative example,the mask image 131 (or the second image data) and the controlinformation may be generated by the graphic processing unit 312 and thecentral processing unit 311, respectively. Since the mask image 131 hasa larger magnitude and longer processing speed than the controlinformation, the times during which the mask image 131 and the controlinformation are transmitted to the display panel 170 may be differentfrom each other.

However, according to an embodiment of the disclosure, the imagegeneration module 333 may directly generate the mask image 131 or selectthe mask image 131 stored in the graphic RAM 325 or the memory 334 andoutput the mask image 131 to the display panel 170. Accordingly, thetiming at which the control information is transmitted to the displaypanel 170 and the timing at which the mask image 131 is output to thedisplay panel 170 may coincide with each other substantially. That is,the timing at which the mask image 131 is output to the display panel170 and the timing at which the pixels emit light brightly (or thetiming at which the electronic device 100 enters the HBM) may becoincide with each other substantially, thereby preventing the glare ofthe user.

In the disclosure, components described with the same reference numeralsas those of the electronic device 100 illustrated in FIGS. 1, 2, and 3may be identically applied to those described with reference to FIGS. 1,2, and 3.

FIG. 4 illustrates a user interface output through an electronic deviceaccording to an embodiment of the disclosure.

Referring to FIG. 4, when it is required to obtain fingerprintinformation of the user, the electronic device 100 (or the applicationprocessor 310) may output a guide 411 through a first screen 410 (e.g.,the home screen). For example, when the user executes a bank applicationfor cash transfer, the fingerprint information of the user is required,and the electronic device 100 may output the guide 411 for displaying aposition of the fingerprint sensor. The guide 411 may at least partiallysurround the fingerprint detection area 132 (e.g., the area where theguide 411 is displayed at least partially overlaps the fingerprintdetection area 132), and the user may recognize the position at whichthe finger 10 is to be touched through the guide 411.

When the user touches at least a portion of the guide 411 with thefinger 10, the electronic device 100 (or the display driver IC 230) maygenerate the mask image 131 and/or an icon 412. The generated mask image131 and/or the icon 412 may be output through a second screen 420. Thesecond screen 420 may refer to, for example, a screen on which the maskimage 131 and/or the icon 412 are output in which pixels emit lightbrightly simultaneously (or the electronic device 100 enters a highbrightness mode (HBM)). The icon 412 may refer to an image output at aposition corresponding to the fingerprint sensor, and may be changedaccording to a user's selection, such as a fingerprint shape, a circleshape, or a star shape.

In another embodiment, when the user touches an area inside the guide411 with the finger 10, the electronic device 100 (or the imagegeneration module 333) may select the mask image 131 and/or the icon 412stored in the graphic RAM 325 or the memory 334. The selected mask image131 and/or the icon 412 may be output through the second screen 420.

In another embodiment, the electronic device 100 may output thegenerated or selected mask image 131 through the second screen 420. Inthis case, the pixels may emit light brightly, but the icon 412 may notbe output.

Although not shown in FIG. 4, when it is required to obtain fingerprintinformation in a screen lock state or an always on display (AOD), theelectronic device 100 may switch the screen from a lock screen to thefirst screen 410. In the state of being switched to the first screen410, the electronic device 100 may output the guide 411 and obtainfingerprint information.

According to an embodiment, the electronic device 100 may adjust abrightness of an area corresponding to the fingerprint sensor 250 and abrightness of a remaining area in the mask image 131. For example, theelectronic device 100 may adjust (or darken) the brightness of an areaof the mask image 131 corresponding to the fingerprint sensor 250 basedon a burn-in degree of the pixels.

FIG. 5 illustrates a user interface output through an electronic deviceaccording to another embodiment.

Referring to FIG. 5, when it is required to obtain fingerprintinformation of a user, the electronic device 100 (or the applicationprocessor 310) may output the guide 411 and the icon 412 through a firstscreen 510 (e.g., a home screen). For example, when the user executes abank application for cash transfer, the electronic device 100 may outputthe guide 411 and the icon 412 because the fingerprint information ofthe user is required. The guide 411 may surround the fingerprintdetection area 132, and the icon 412 may be output at a positioncorresponding to the fingerprint sensor.

When the user touch the icon 412 with the finger 10, the electronicdevice 100 (or the display driver IC 230) may generate the mask image131. The generated mask image 131 may be output through a second screen520. The second screen 520 may refer to, for example, a screen on whichthe mask image 131 is output simultaneously when pixels emit lightbrightly (simultaneously when the electronic device 100 enters a highbrightness mode (HBM)).

In another embodiment, when the user touches the icon 412 with thefinger 10, the electronic device 100 (or the image generation module333) may select the mask image 131 stored in the graphic RAM 325 or thememory 334. The selected mask image 131 may be output through the secondscreen 520.

Although not shown in FIG. 5, when it is required to obtain fingerprintinformation in a screen lock state or an always on display (AOD), theelectronic device 100 may switch the screen from a lock screen to thefirst screen 510. In the state of being switched to the first screen510, the electronic device 100 may output the guide 411 and the icon 412and obtain fingerprint information.

FIG. 6 is a timing diagram of components included in the electronicdevice 100 according to an embodiment.

Referring to FIG. 6, graph 610 represents a synchronization signal,graph 620 represents a control signal for directing the electronicdevice 100 to enter a high brightness mode (HBM), and graph 630represents whether or not the electronic device 100 has entered the HBM.The synchronization signal may indicate a timing at which a signal(e.g., a data signal) is transmitted from the display driver IC 230 tothe display panel 170. The high state in graph 620 may indicate that thedisplay driver IC 230 has transmitted a control signal to the displaypanel 170. The high state in graph 630 may indicate that the electronicdevice 100 has entered the HBM.

Referring to graphs 610, 620, and 630, the display driver IC 230 maytransmit a control signal to the display panel 170 in synchronizationwith the synchronization signal. The electronic device 100 may enter theHBM and pixels disposed on the display panel 170 may emit light brightlyinstantaneously because the control signal is transmitted to the displaypanel 170.

Meanwhile, when the display driver IC 230 transmits the control signal,the electronic device 100 (or the display driver IC 230) may output themask image 131 through the display panel 170. In other words, a timingat which the mask image 131 is output through the display panel 170 anda timing at which the pixels emit light brightly may coincide with eachother substantially. Thus, when viewed from above the display panel 170,the display panel 170 may be dark except for the fingerprint detectionarea 132.

According to the embodiment of the disclosure, it is possible to preventflickering or glaring of the display (e.g., prevent a user fromrecognizing flickering of the display) and improve user convenience bymaking the timing at which the mask image 131 is output through thedisplay panel 170 and the timing at which the pixels emit light brightlyinstantaneously coincident with each other substantially.

According to an embodiment of the disclosure, an electronic device mayinclude a housing, a display panel including a plurality of pixelshoused in the housing, a flexible printed circuit board electricallyconnected to the display panel, a fingerprint sensor disposed under atleast a portion of the display panel and on the flexible printed circuitboard, a display driver integrated circuit (IC), and a processorelectrically connected to the fingerprint sensor and the display driverIC, wherein the processor may allow the display driver IC to output amask image having a specified brightness through the display panel at afirst timing when a contact by an external object is detected using theat least a portion, and allow at least one of the plurality of pixels toemit light using the display driver IC at a second timing correspondingto the first timing.

According to an embodiment of the disclosure, the processor may allowthe display driver IC to generate the mask image and outputs the maskimage through the display panel at the first timing.

According to an embodiment of the disclosure, the processor may generatethe mask image, and the display driver IC may include a memoryconfigured to store the generated mask image and a controller configuredto select the mask image stored in the memory and output the mask imagethrough the display panel.

According to an embodiment of the disclosure, the memory may include agraphic RAM (GRAM).

According to an embodiment of the disclosure, the processor may allowthe display driver IC to form a hole in an area corresponding to the atleast a portion of the mask image.

According to an embodiment of the disclosure, the processor may allowthe display driver IC to output an icon having a specified shape in anarea corresponding to the at least a portion.

According to an embodiment of the disclosure, the processor may allowthe display driver IC to output icon at the first timing.

According to an embodiment of the disclosure, the processor may output aguide surrounding the at least a portion through the display panel whena condition for obtaining fingerprint information is satisfied throughthe fingerprint sensor.

According to an embodiment of the disclosure, the processor may outputan icon having a specified shape in an area corresponding to the atleast a portion.

According to an embodiment, the first timing coincides with the secondtiming.

According to an embodiment of the disclosure, an electronic device mayinclude a processor, a display panel, an image sensor disposed in aspecified area of the display panel or under the display panel, and adisplay driver integrated circuit (IC) that drives the display panel,the display driver IC including a memory that stores an icon imageoutput to an area corresponding to the specified area, wherein thedisplay driver IC may identify reception of a signal related to a changein a brightness of the display panel from the processor, display abackground image having a specified brightness and the icon image basedat least on the signal, and emit light using at least partially an areacorresponding to the icon image to obtain information corresponding to afingerprint of an external object using the image sensor.

According to an embodiment of the disclosure, the display driver IC mayallow a first group of pixels disposed in an area corresponding to thespecified area to emit light at a first brightness, and allow a secondgroup of pixels except for the first group of pixels among pixelsdisposed on the display panel to emit light at a second brightness.

According to an embodiment of the disclosure, a timing at which thebackground image and the icon image are displayed and a timing at whichthe light is emitted may coincide with each other.

According to an embodiment of the disclosure, the display driver IC mayreceive the background image from the processor and stores thebackground image.

According to an embodiment of the disclosure, the display driver IC mayreceive the signal and the background image from the processor within aspecified period of time or for different periods of time.

According to an embodiment of the disclosure, an electronic device mayinclude a processor, a display panel, an image sensor disposed in aspecified area of the display panel or under the display panel, adisplay driver integrated circuit (IC) that drives the display panel,and a memory that stores a mask image having a specified brightness,wherein the display driver IC may identify reception of a signal relatedto a change in a brightness of the display panel from the processor andoutput the mask image through the display panel based on the signal anda transparency of a first area of the mask image corresponding to thespecified area and a transparency of a second area of the mask imageexcept for the first area may be different from each other.

According to an embodiment of the disclosure, the display driver IC maychange the brightness of the display panel based on the signal andoutput the mask image through the display panel at a timing coincidingwith a timing at which the brightness is changed.

According to an embodiment of the disclosure, the display driver IC mayreceive a background image at a timing coinciding with a timing at whichthe signal is received from the processor or receive the backgroundimage at a timing different from the timing at which the signal isreceived.

According to an embodiment of the disclosure, an electronic device mayinclude a processor, a display panel operable in a first operation modeof a specified brightness or a second operation mode different from thefirst operation mode, and a display driver IC that drives the displaypanel, wherein the display driver IC may identify reception of a signalrelated to switching from the first operation mode to the secondoperation mode, obtain an image including a transparency in a specifiedrange when the signal is received, synchronize a time point at which theobtained image is displayed on the display panel and a time point atwhich switching to the second operation mode is performed with aspecified time point, and display the image using the display panelwhich is driven in the second operation mode after a time point whichthe synchronization is made.

According to an embodiment, the image having the transparency in thespecified range may be stored in a specified memory area in the displaydriver IC.

FIG. 7 is a block diagram of an electronic device in a networkenvironment for recognizing a fingerprint, according to variousembodiments.

FIG. 7 is a block diagram illustrating an electronic device 701 in anetwork environment 700 according to various embodiments. Referring toFIG. 7, the electronic device 701 in the network environment 700 maycommunicate with an electronic device 702 via a first network 798 (e.g.,a short-range wireless communication network), or an electronic device704 or a server 708 via a second network 799 (e.g., a long-rangewireless communication network). According to an embodiment, theelectronic device 701 may communicate with the electronic device 704 viathe server 708. According to an embodiment, the electronic device 701may include a processor 720, memory 730, an input device 750, a soundoutput device 755, a display device 760, an audio module 770, a sensormodule 776, an interface 777, a haptic module 779, a camera module 780,a power management module 788, a battery 789, a communication module790, a subscriber identification module (SIM) 796, or an antenna module797. In some embodiments, at least one (e.g., the display device 760 orthe camera module 780) of the components may be omitted from theelectronic device 701, or one or more other components may be added inthe electronic device 701. In some embodiments, some of the componentsmay be implemented as single integrated circuitry. For example, thesensor module 776 (e.g., a fingerprint sensor, an iris sensor, or anilluminance sensor) may be implemented as embedded in the display device760 (e.g., a display).

The processor 720 may execute, for example, software (e.g., a program740) to control at least one other component (e.g., a hardware orsoftware component) of the electronic device 701 coupled with theprocessor 720, and may perform various data processing or computation.According to one embodiment, as at least part of the data processing orcomputation, the processor 720 may load a command or data received fromanother component (e.g., the sensor module 776 or the communicationmodule 790) in volatile memory 732, process the command or the datastored in the volatile memory 732, and store resulting data innon-volatile memory 734. According to an embodiment, the processor 720may include a main processor 721 (e.g., a central processing unit (CPU)or an application processor (AP)), and an auxiliary processor 723 (e.g.,a graphics processing unit (GPU), an image signal processor (ISP), asensor hub processor, or a communication processor (CP)) that isoperable independently from, or in conjunction with, the main processor721. Additionally or alternatively, the auxiliary processor 723 may beadapted to consume less power than the main processor 721, or to bespecific to a specified function. The auxiliary processor 723 may beimplemented as separate from, or as part of the main processor 721.

The auxiliary processor 723 may control at least some of functions orstates related to at least one component (e.g., the display device 760,the sensor module 776, or the communication module 790) among thecomponents of the electronic device 701, instead of the main processor721 while the main processor 721 is in an inactive (e.g., sleep) state,or together with the main processor 721 while the main processor 721 isin an active state (e.g., executing an application). According to anembodiment, the auxiliary processor 723 (e.g., an image signal processoror a communication processor) may be implemented as part of anothercomponent (e.g., the camera module 780 or the communication module 790)functionally related to the auxiliary processor 723.

The memory 730 may store various data used by at least one component(e.g., the processor 720 or the sensor module 776) of the electronicdevice 701. The various data may include, for example, software (e.g.,the program 740) and input data or output data for a command relatedthereto. The memory 730 may include the volatile memory 732 or thenon-volatile memory 734.

The program 740 may be stored in the memory 730 as software, and mayinclude, for example, an operating system (OS) 742, middleware 744, oran application 746.

The input device 750 may receive a command or data to be used by othercomponent (e.g., the processor 720) of the electronic device 701, fromthe outside (e.g., a user) of the electronic device 701. The inputdevice 750 may include, for example, a microphone, a mouse, a keyboard,or a digital pen (e.g., a stylus pen).

The sound output device 755 may output sound signals to the outside ofthe electronic device 701. The sound output device 755 may include, forexample, a speaker or a receiver. The speaker may be used for generalpurposes, such as playing multimedia or playing record, and the receivermay be used for an incoming calls. According to an embodiment, thereceiver may be implemented as separate from, or as part of the speaker.

The display device 760 may visually provide information to the outside(e.g., a user) of the electronic device 701. The display device 760 mayinclude, for example, a display, a hologram device, or a projector andcontrol circuitry to control a corresponding one of the display,hologram device, and projector. According to an embodiment, the displaydevice 760 may include touch circuitry adapted to detect a touch, orsensor circuitry (e.g., a pressure sensor) adapted to measure theintensity of force incurred by the touch.

The audio module 770 may convert a sound into an electrical signal andvice versa. According to an embodiment, the audio module 770 may obtainthe sound via the input device 750, or output the sound via the soundoutput device 755 or a headphone of an external electronic device (e.g.,an electronic device 702) directly (e.g., wiredly) or wirelessly coupledwith the electronic device 701.

The sensor module 776 may detect an operational state (e.g., power ortemperature) of the electronic device 701 or an environmental state(e.g., a state of a user) external to the electronic device 701, andthen generate an electrical signal or data value corresponding to thedetected state. According to an embodiment, the sensor module 776 mayinclude, for example, a gesture sensor, a gyro sensor, an atmosphericpressure sensor, a magnetic sensor, an acceleration sensor, a gripsensor, a proximity sensor, a color sensor, an infrared (IR) sensor, abiometric sensor, a temperature sensor, a humidity sensor, or anilluminance sensor.

The interface 777 may support one or more specified protocols to be usedfor the electronic device 701 to be coupled with the external electronicdevice (e.g., the electronic device 702) directly (e.g., wiredly) orwirelessly. According to an embodiment, the interface 777 may include,for example, a high definition multimedia interface (HDMI), a universalserial bus (USB) interface, a secure digital (SD) card interface, or anaudio interface.

A connecting terminal 778 may include a connector via which theelectronic device 701 may be physically connected with the externalelectronic device (e.g., the electronic device 702). According to anembodiment, the connecting terminal 778 may include, for example, a HDMIconnector, a USB connector, a SD card connector, or an audio connector(e.g., a headphone connector).

The haptic module 779 may convert an electrical signal into a mechanicalstimulus (e.g., a vibration or a movement) or electrical stimulus whichmay be recognized by a user via his tactile sensation or kinestheticsensation. According to an embodiment, the haptic module 779 mayinclude, for example, a motor, a piezoelectric element, or an electricstimulator.

The camera module 780 may capture a still image or moving images.According to an embodiment, the camera module 780 may include one ormore lenses, image sensors, image signal processors, or flashes.

The power management module 788 may manage power supplied to theelectronic device 701. According to one embodiment, the power managementmodule 788 may be implemented as at least part of, for example, a powermanagement integrated circuit (PMIC).

The battery 789 may supply power to at least one component of theelectronic device 701. According to an embodiment, the battery 789 mayinclude, for example, a primary cell which is not rechargeable, asecondary cell which is rechargeable, or a fuel cell.

The communication module 790 may support establishing a direct (e.g.,wired) communication channel or a wireless communication channel betweenthe electronic device 701 and the external electronic device (e.g., theelectronic device 702, the electronic device 704, or the server 708) andperforming communication via the established communication channel. Thecommunication module 790 may include one or more communicationprocessors that are operable independently from the processor 720 (e.g.,the application processor (AP)) and supports a direct (e.g., wired)communication or a wireless communication. According to an embodiment,the communication module 790 may include a wireless communication module792 (e.g., a cellular communication module, a short-range wirelesscommunication module, or a global navigation satellite system (GNSS)communication module) or a wired communication module 794 (e.g., a localarea network (LAN) communication module or a power line communication(PLC) module). A corresponding one of these communication modules maycommunicate with the external electronic device via the first network798 (e.g., a short-range communication network, such as Bluetooth™,wireless-fidelity (Wi-Fi) direct, or infrared data association (IrDA))or the second network 799 (e.g., a long-range communication network,such as a cellular network, the Internet, or a computer network (e.g.,LAN or wide area network (WAN)). These various types of communicationmodules may be implemented as a single component (e.g., a single chip),or may be implemented as multi components (e.g., multi chips) separatefrom each other. The wireless communication module 792 may identify andauthenticate the electronic device 701 in a communication network, suchas the first network 798 or the second network 799, using subscriberinformation (e.g., international mobile subscriber identity (IMSI))stored in the subscriber identification module 796.

The antenna module 797 may transmit or receive a signal or power to orfrom the outside (e.g., the external electronic device) of theelectronic device 701. According to an embodiment, the antenna module797 may include an antenna including a radiating element composed of aconductive material or a conductive pattern formed in or on a substrate(e.g., PCB). According to an embodiment, the antenna module 797 mayinclude a plurality of antennas. In such a case, at least one antennaappropriate for a communication scheme used in the communicationnetwork, such as the first network 798 or the second network 799, may beselected, for example, by the communication module 790 (e.g., thewireless communication module 792) from the plurality of antennas. Thesignal or the power may then be transmitted or received between thecommunication module 790 and the external electronic device via theselected at least one antenna. According to an embodiment, anothercomponent (e.g., a radio frequency integrated circuit (RFIC)) other thanthe radiating element may be additionally formed as part of the antennamodule 797.

At least some of the above-described components may be coupled mutuallyand communicate signals (e.g., commands or data) therebetween via aninter-peripheral communication scheme (e.g., a bus, general purposeinput and output (GPIO), serial peripheral interface (SPI), or mobileindustry processor interface (MIPI)).

According to an embodiment, commands or data may be transmitted orreceived between the electronic device 701 and the external electronicdevice 704 via the server 708 coupled with the second network 799. Eachof the electronic devices 702 and 704 may be a device of a same type as,or a different type, from the electronic device 701. According to anembodiment, all or some of operations to be executed at the electronicdevice 701 may be executed at one or more of the external electronicdevices 702, 704, or 708. For example, if the electronic device 701should perform a function or a service automatically, or in response toa request from a user or another device, the electronic device 701,instead of, or in addition to, executing the function or the service,may request the one or more external electronic devices to perform atleast part of the function or the service. The one or more externalelectronic devices receiving the request may perform the at least partof the function or the service requested, or an additional function oran additional service related to the request, and transfer an outcome ofthe performing to the electronic device 701. The electronic device 701may provide the outcome, with or without further processing of theoutcome, as at least part of a reply to the request. To that end, acloud computing, distributed computing, or client-server computingtechnology may be used, for example.

The electronic device according to various embodiments may be one ofvarious types of electronic devices. The electronic devices may include,for example, a portable communication device (e.g., a smartphone), acomputer device, a portable multimedia device, a portable medicaldevice, a camera, a wearable device, or a home appliance. According toan embodiment of the disclosure, the electronic devices are not limitedto those described above.

It should be appreciated that various embodiments of the presentdisclosure and the terms used therein are not intended to limit thetechnological features set forth herein to particular embodiments andinclude various changes, equivalents, or replacements for acorresponding embodiment. With regard to the description of thedrawings, similar reference numerals may be used to refer to similar orrelated elements. It is to be understood that a singular form of a nouncorresponding to an item may include one or more of the things, unlessthe relevant context clearly indicates otherwise. As used herein, eachof such phrases as “A or B,” “at least one of A and B,” “at least one ofA or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least oneof A, B, or C,” may include any one of, or all possible combinations ofthe items enumerated together in a corresponding one of the phrases. Asused herein, such terms as “1st” and “2nd,” or “first” and “second” maybe used to simply distinguish a corresponding component from another,and does not limit the components in other aspect (e.g., importance ororder). It is to be understood that if an element (e.g., a firstelement) is referred to, with or without the term “operatively” or“communicatively”, as “coupled with,” “coupled to,” “connected with,” or“connected to” another element (e.g., a second element), it means thatthe element may be coupled with the other element directly (e.g.,wiredly), wirelessly, or via a third element.

As used herein, the term “module” may include a unit implemented inhardware, software, or firmware, and may interchangeably be used withother terms, for example, “logic,” “logic block,” “part,” or“circuitry”. A module may be a single integral component, or a minimumunit or part thereof, adapted to perform one or more functions. Forexample, according to an embodiment, the module may be implemented in aform of an application-specific integrated circuit (ASIC).

Various embodiments as set forth herein may be implemented as software(e.g., the program 740) including one or more instructions that arestored in a storage medium (e.g., internal memory 736 or external memory738) that is readable by a machine (e.g., the electronic device 701).For example, a processor (e.g., the processor 720) of the machine (e.g.,the electronic device 701) may invoke at least one of the one or moreinstructions stored in the storage medium, and execute it, with orwithout using one or more other components under the control of theprocessor. This allows the machine to be operated to perform at leastone function according to the at least one instruction invoked. The oneor more instructions may include a code generated by a compiler or acode executable by an interpreter. The machine-readable storage mediummay be provided in the form of a non-transitory storage medium. Wherein,the term “non-transitory” simply means that the storage medium is atangible device, and does not include a signal (e.g., an electromagneticwave), but this term does not differentiate between where data issemi-permanently stored in the storage medium and where the data istemporarily stored in the storage medium.

According to an embodiment, a method according to various embodiments ofthe disclosure may be included and provided in a computer programproduct. The computer program product may be traded as a product betweena seller and a buyer. The computer program product may be distributed inthe form of a machine-readable storage medium (e.g., compact disc readonly memory (CD-ROM)), or be distributed (e.g., downloaded or uploaded)online via an application store (e.g., PlayStore™), or between two userdevices (e.g., smart phones) directly. If distributed online, at leastpart of the computer program product may be temporarily generated or atleast temporarily stored in the machine-readable storage medium, such asmemory of the manufacturer's server, a server of the application store,or a relay server.

According to various embodiments, each component (e.g., a module or aprogram) of the above-described components may include a single entityor multiple entities. According to various embodiments, one or more ofthe above-described components may be omitted, or one or more othercomponents may be added. Alternatively or additionally, a plurality ofcomponents (e.g., modules or programs) may be integrated into a singlecomponent. In such a case, according to various embodiments, theintegrated component may still perform one or more functions of each ofthe plurality of components in the same or similar manner as they areperformed by a corresponding one of the plurality of components beforethe integration. According to various embodiments, operations performedby the module, the program, or another component may be carried outsequentially, in parallel, repeatedly, or heuristically, or one or moreof the operations may be executed in a different order or omitted, orone or more other operations may be added.

FIG. 8 is a block diagram of a display device for recognizing afingerprint, according to various embodiments.

FIG. 8 is a block diagram 800 illustrating the display device 760according to various embodiments. Referring to FIG. 8, the displaydevice 760 may include a display 810 and a display driver integratedcircuit (DDI) 830 to control the display 810. The DDI 830 may include aninterface module 831, memory 833 (e.g., buffer memory), an imageprocessing module 835, or a mapping module 837. The DDI 830 may receiveimage information that contains image data or an image control signalcorresponding to a command to control the image data from anothercomponent of the electronic device 701 via the interface module 831. Forexample, according to an embodiment, the image information may bereceived from the processor 720 (e.g., the main processor 721 (e.g., anapplication processor)) or the auxiliary processor 723 (e.g., a graphicsprocessing unit) operated independently from the function of the mainprocessor 721. The DDI 830 may communicate, for example, with touchcircuitry 750 or the sensor module 776 via the interface module 831. TheDDI 830 may also store at least part of the received image informationin the memory 833, for example, on a frame by frame basis.

The image processing module 835 may perform pre-processing orpost-processing (e.g., adjustment of resolution, brightness, or size)with respect to at least part of the image data. According to anembodiment, the pre-processing or post-processing may be performed, forexample, based at least in part on one or more characteristics of theimage data or one or more characteristics of the display 810.

The mapping module 837 may generate a voltage value or a current valuecorresponding to the image data pre-processed or post-processed by theimage processing module 835. According to an embodiment, the generatingof the voltage value or current value may be performed, for example,based at least in part on one or more attributes of the pixels (e.g., anarray, such as an RGB stripe or a pentile structure, of the pixels, orthe size of each subpixel). At least some pixels of the display 810 maybe driven, for example, based at least in part on the voltage value orthe current value such that visual information (e.g., a text, an image,or an icon) corresponding to the image data may be displayed via thedisplay 810.

According to an embodiment, the display device 760 may further includethe touch circuitry 850. The touch circuitry 850 may include a touchsensor 851 and a touch sensor IC 853 to control the touch sensor 851.The touch sensor IC 853 may control the touch sensor 851 to sense atouch input or a hovering input with respect to a certain position onthe display 810. To achieve this, for example, the touch sensor 851 maydetect (e.g., measure) a change in a signal (e.g., a voltage, a quantityof light, a resistance, or a quantity of one or more electric charges)corresponding to the certain position on the display 810. The touchcircuitry 850 may provide input information (e.g., a position, an area,a pressure, or a time) indicative of the touch input or the hoveringinput detected via the touch sensor 851 to the processor 720. Accordingto an embodiment, at least part (e.g., the touch sensor IC 853) of thetouch circuitry 850 may be formed as part of the display 810 or the DDI830, or as part of another component (e.g., the auxiliary processor 723)disposed outside the display device 760.

According to an embodiment, the display device 760 may further includeat least one sensor (e.g., a fingerprint sensor, an iris sensor, apressure sensor, or an illuminance sensor) of the sensor module 776 or acontrol circuit for the at least one sensor. In such a case, the atleast one sensor or the control circuit for the at least one sensor maybe embedded in one portion of a component (e.g., the display 810, theDDI 830, or the touch circuitry 750)) of the display device 760. Forexample, when the sensor module 776 embedded in the display device 760includes a biometric sensor (e.g., a fingerprint sensor), the biometricsensor may obtain biometric information (e.g., a fingerprint image)corresponding to a touch input received via a portion of the display810. As another example, when the sensor module 776 embedded in thedisplay device 760 includes a pressure sensor, the pressure sensor mayobtain pressure information corresponding to a touch input received viaa partial or whole area of the display 810. According to an embodiment,the touch sensor 851 or the sensor module 776 may be disposed betweenpixels in a pixel layer of the display 810, or over or under the pixellayer.

The invention claimed is:
 1. An electronic device comprising: a coverwindow; a display panel, including a plurality of pixels, disposed underthe cover window; a fingerprint sensor disposed under a sensor portionof the display panel; a display driver integrated circuit (IC)electrically connected to the display panel; and a processorelectrically connected to the fingerprint sensor and the display driverIC, wherein the processor is configured to: provide a first image to thedisplay driver IC, the first image including a visual guide forrequesting a contact for fingerprint-sensing at an area of the coverwindow corresponding to the sensor portion of the display panel, causethe display driver IC to output the first image through the displaypanel with a first brightness, and according to detecting a contact withrespect to the visual guide, cause the display driver IC to: generate asecond image by using the first image, and output the second image witha second brightness on an area excluding the sensor portion of thedisplay panel and a third image on the sensor portion to emit, by pixelsof the sensor portion, light for acquiring fingerprint information,wherein the second brightness is darker than the first brightness. 2.The electronic device of claim 1, wherein the processor allows thedisplay driver IC to generate the second image by using a mask image andoutputs the second image through the display panel at a first timing. 3.The electronic device of claim 2, wherein the processor generates themask image, and wherein the display driver IC includes a memoryconfigured to store the generated mask image and a controller configuredto select the mask image stored in the memory and generate the secondimage.
 4. The electronic device of claim 3, wherein the memory includesa graphic RAM (GRAM).
 5. The electronic device of claim 1, wherein theprocessor allows the display driver IC to generate a mask image toinclude a hole corresponding to the sensor portion of the display panel.6. The electronic device of claim 1, wherein the processor allows thedisplay driver IC to output the third image having a specified shape inan area corresponding to the sensor portion of the display panel.
 7. Theelectronic device of claim 6, wherein the processor allows the displaydriver IC to output the third image at a first timing.
 8. The electronicdevice of claim 1, wherein the processor outputs the visual guidesurrounding the sensor portion through the display panel when acondition for obtaining the fingerprint information through thefingerprint sensor is satisfied.
 9. The electronic device of claim 8,wherein the processor allows the display driver IC to outputs the thirdimage having a specified shape in an area corresponding to the sensorportion of the display panel.
 10. The electronic device of claim 1,wherein when the second image is displayed, the display panel enters ahigh brightness mode, and wherein the second image causes the areaexcluding the sensor portion of the display panel to have the secondbrightness in the high brightness mode, and wherein the third imagecauses the pixels of the sensor portion to have a third brightness thatis higher than the first brightness.
 11. An electronic devicecomprising: a cover window; a display panel, including a plurality ofpixels, disposed under the cover window; a fingerprint sensor disposedunder a sensor portion of the display panel; a display driver integratedcircuit (IC) electrically connected to the display panel; and aprocessor electrically connected to the fingerprint sensor and thedisplay driver IC, wherein the processor is configured to: provide afirst image to the display driver IC, the first image including a visualguide for requesting a contact for fingerprint-sensing at an area of thecover window corresponding to the sensor portion of the display panel,cause the display driver IC to output the first image through thedisplay panel with a first brightness, and when a contact with respectto the visual guide is detected, cause the display driver IC to generatea second image on the sensor portion of the display panel to emit, bypredetermined pixels of the sensor portion, light for acquiringfingerprint information, wherein the second image has a secondbrightness is brighter than the first brightness, and wherein the firstimage is displayed at a brightness darker than the first brightness.